---
title: DeepInfra
sidebarTitle: DeepInfra
---

The DeepInfra model provides access to DeepInfra's hosted language models.

## Parameters

| Parameter    | Type               | Default                                       | Description                                                           |
| ------------ | ------------------ | --------------------------------------------- | --------------------------------------------------------------------- |
| `id`         | `str`              | `"meta-llama/Llama-2-70b-chat-hf"`           | The id of the DeepInfra model to use                                 |
| `name`       | `str`              | `"DeepInfra"`                                | The name of the model                                                 |
| `provider`   | `str`              | `"DeepInfra"`                                | The provider of the model                                             |
| `api_key`    | `Optional[str]`    | `None`                                        | The API key for DeepInfra (defaults to DEEPINFRA_API_KEY env var)    |
| `base_url`   | `str`              | `"https://api.deepinfra.com/v1/openai"`      | The base URL for the DeepInfra API                                    |

DeepInfra extends the OpenAI-compatible interface and supports most parameters from OpenAI.
